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We demonstrate that a potential coexists with limit cycle. Here the potential determines the final 
distribution of population. Our demonstration consists of three steps: We first show the existence 
of limit from a typical physical sciences setting: the potential is a type of Mexican hat type, with 
the strength of a magnetic field scale with the strength the potential gradient near the limit cycle, 
and the friction goes to zero faster than the potential near the limit cycle. Hence the dynamics at 
the limit cycle is conserved. The diffusion matrix is nevertheless finite at the limit cycle. Secondly, 
we construct the potential in the dynamics with limit cycle in a typical dynamical systems setting. 
Thirdly, we argue that such a construction can be carried out in a more general situation based 
on a method discovered by one of us. This method of dealing with stochastic differential equation 
is in general different from both Ito and Stratonovich calculus. Our result may be useful in many 
related applications, such as in the discussion of metastability of limit cycle and in the construction 
of Hopfield potential in the neural network computation. 



I. INTRODUCTION 

Noise perturbed dynamics systems with limit cycles 
are abounded in physical sciences. It is one of the driv- 
ing forces in the study of nonlinear systems 1 ^. Until 
recently, one of the most useful concepts in physical sci- 
ences, the potential energy function, had been found 
to be not applicable in general^. Hence, it has been 
concluded that the no Lyapunov function or potential 
function with periodic attractors, in the neural network 
computing 4 . Similar statements can also be found in 
many other fields. When the matastability and the de- 
cay of metability state are discussed, efforts have been 
made to avoid the use of potential energy function in the 
form of Boltzmann-Gibbs distribution. Various methods 
which can go around this issue, such as the Machlup- 
Onsager functional method, quasipotentials, etc, have 
been developed^. They have been successfully applied to 
situations with limit cycle dynamics, such as in the dis- 
cussion of topological structure of the decay of metastable 
limit cycled, in the numerical study of trajectory of the 
escaping patbi. However, even in such settings, there is 
a need to consider potential energy function, such as in- 
dicated in the escape of asteroids in the solar system 8 . 
Hence, it is a natural question to ask what would be 
the connection between such an approach and the classi- 
cal approach based on potential energy functior&iS, and 
whether or not the potential function exists in dynamics 
with limit cycle. The purpose of the present article is to 
give an explicit demonstration that at least for the case 
of limit cycle dynamics, potential function can be explic- 
itly constructed, which provides a critical link between 
those two ways of dealing with metastability. 

Our construction is based on a novel way of handling 
the stochastic differential equation. It can be understood 
as the zero mass limit of a generalized Klein-Kramers 
equation^. In this limit the steady state distribution can 
be established from the Klein-Kramers equation with- 



out the concerns of the Ito or Stratnovich calculus. In 
this sense it would not be surprising that a different per- 
spective can be obtained other than those in Ref . f£iii&] . 
Wc believe that our following demonstration provides an 
important step for an alternative understanding of the 
nonequilibrium processes such as limit cycles. 

We will demonstrate the co-existence of a potential 
with limit cycle in three steps in three sections, respec- 
tively. In section II we explicitly demonstrate how to 
construct a limit cycle based on our knowledge in phys- 
ical sciences, with a potential. This is different from the 
usual approach in dynamical systems. In section III wc 
demonstrate how to construct a potential in the presence 
of a limit cycle in the dynamical systems setting. In sec- 
tion IV we outline a general construction of potential in a 
broad class of dynamical systems, including limit cycles. 
In section V we discuss two mathematical subtleties. In 
section VI we conclude that the potential can co-exist 
with limit cycle and with possibly more complicated dy- 
namics. 



II. LIMIT CYCLE: PHYSICAL SCIENCES' 
POINT OF VIEW 

In physical sciences, the general dynamical equation 
for a massless particle in two dimensional state space may 
be expressed as, with both deterministic and stochastic 
forcesii: 

[S(q, *) + T(q, t)]q = -V^(q, t) + £(q, t) , (1) 

and supplemented by the relationship on the stochastic 
force: 

<£(q J t)r(q J * / )> = 2S(q,f)e*(t-0 , (2) 

and (£(q, t)) = 0. Here q T = (91,92) with q\,q^ the two 
Cartesian coordinates of the state space, which may be 



2 



perceived as the position space of the massless particle. 
The transpose is denoted by the superscript t, and q = 
dq/dt. 

The scalar function ip will is the usual potential energy 
function. Its graphical representation in the state space is 
a landscape. The antisymmetric matrix T represents the 
dynamics which conserves the potential, corresponding 
to the Lorentz force in physical sciences, determined by 
the magnetic field. The matrix S represents the dynam- 
ics which decreases the potential, the dissipation. This 
matrix will be called friction matrix. The friction matrix 
is connected to the stochastic force £ by Eq.(2), which 
guarantees that it is nonnegative and symmetric. All 
T, S, ip can be nonlinear functions of the state variable q 
as well as the time t. The numerical parameter e corre- 
sponds to an effective temperature, which will be taken 
to be zero to recover the deterministic dynamics. It has 
been shown that if a steady state distribution p(q) in 
state space exists, 



p(q) oc exp 



^(q) 



(3) 



a Boltzmann-Gibbs type distribution function 2 . Eq.(3) 
implies that for dynamics which repeats itself indefinitely, 
such as limit cycle, the potential may be the same along 
such trajectory. 

It should be pointed that the potential function r/>(q, t) 
exists from the beginning by construction. This is one of 
most useful quantitative concepts in physical sciences. If 
the stochastic force could be set to be zero, £(q, t) = 0, 
that is, the deterministic dynamics, the dynamics of this 
massless particle always decreases its potential energy: 



q T W(q,t) = -qf[S(q,t) + T(q,t)]q 
= -cfS(q,t)q 
< . 



(4) 



The zero occurs only at the limiting set. Hence the po- 
tential function has the usual meaning of Lyapunov func- 
tion. 

To model a limit cycle, we choose following forms for 
the friction matrix S, the anti-symmetric matrix T, and 
the potential ip, assuming the limit cycle occurs at q — 



= 



s 

T 



1) 



(q 2 - l) 2 

(9-1) 
1 



1 
1 V 1 

,2 



(<z 2 

(« -I) 2 



i Y + i 



-1 

1 



(5) 
(6) 
(7) 



The potential ip given in Eq.(7) is rotational symmetric 
in the state space. It has a local maximum ip = 1/2 at 
q = 0, which is a fixed point, and the minimum -0 = 
at q = 1, which is a cycle in the state space. Hence the 
potential takes the shape of Mexican hat type. 



Evidently, if the friction matrix S would be zero, the 
dynamical trajectory of the massless particle would move 
along the equal potential contour determined by the ini- 
tial condition, which would be a cycle according to above 
chosen potential. In the presence of nonzero friction ma- 
trix, this is not true. What will be our concern is the 
behavior near the minimum of the potential function: 
When q is sufficiently close to 1, does the particle tra- 
jectory asymptotically approach the cycle of q = 1 and 
eventually coincide with it? If the answer is positive, we 
have a limit cycle dynamics. We will demonstrate below 
that it is indeed possible. 

For a deterministic dynamics, we can set e = in 
Eq.(l) and (2): setting the stochastic force to be zero. 
The dynamical equation can then be rewritten as 



q=-[,S(q,<)+r(q,t)]- 1 VV(q,i) 
With the choice of Eqs. (5-7), we have 
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and det(5 + T) = [{q 2 - l) 2 /((g 2 - l) 2 + l)] 2 
l) 2 q 4 /[{q 2 - l) 2 + l] 2 . Near q = 1, we have 
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+ O((g-l) 2 )(10) 



In terms of radial coordinate q and azimuth angle 6 in the 
polar coordinate representation of the state space, using 
the small parameter expansion given in Eq.(10) following 
Eq.(8) we have, to the order of q — 1, 



The solution is 

Q(t) = 
6(t) = 



= -4(9-1) 

q- i 

= 1-2- 



1 + 5q Q exp {-4t} 
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ln(l + 5q exp {-At}) 



(11) 
(12) 

(13) 
(14) 



Here 5qo (\5qo\ << 1) is the starting radial position of 
the particle measured from 9=1 and #o its the starting 
azimuth angle. Indeed, the solution demonstrates the 
asymptotical approaching to the cycle 9 = 1, and the 
motion never stops. Unstable and metable limit cycles 
may be constructed in the similar manner. 

Though above construction does show that based on 
the knowledge of physical sciences one can construct limit 
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cycle with a potential, the example of Eqs.(5-7) appears 
contrived. We should, however, point out that there are 
several generic features in our construction. First, to 
have an indefinitely motion on a closed trajectory, be- 
cause of energy conservation, the friction, or better the 
friction matrix here, must be zero. Second, because of 
the asymptotic motion is on the equal potential contour, 
a Lorentz force type must exist to keep the motion on 
the contour. This means that the antisymmetric matrix 
should be finite along the equal motion contour when 
the potential gradient is finite. The speed of the mass- 
less particle moving along the contour will be determined 
by the ratio of the strength of the Lorentz like force to 
that of the gradient of the potential. Third, because the 
limit cycle should be robust: Small parameter changes 
should only have a small effect on the limit cycle, the 
(stable) limit cycle should be at the minimum of the po- 
tential. As a consequence, the potential gradient at the 
maximum is zero, which would imply that the friction 
matrix must go to zero faster than that of the potential 
gradient when approaching to the maximum to avoid the 
potential taking singular values. This means that at the 
limit cycle the dynamics is conserved. All those features 
are explicitly implemented in the choice, Eqs.(5-7). 

Two additional remarks are in order. For simplicity 
of calculation we have chosen the friction matrix to be a 
constant matrix in Eq.(5). One can check that any pos- 
itive definite symmetric matrix can lead to above same 
conclusion, as long as its strength goes to zero in a higher 
order comparing to that of the potential gradient. The 
second remark is that although S is zero when approach- 
ing to the limit cycle, [S + T] _1 + [S - T]~ x is not, on 
which we will come back later when discussing the diffu- 
sion matrix in section V. 



III. LIMIT CYCLE: SIMPLE CASE IN 
DYNAMICAL SYSTEMS 

The demonstration of the co-existence of limit cycle 
with potential in section II may appear special: The 
particle moves along the potential minimum with both 
zero friction and zero transverse matrices, a nice picture 
from physical sciences. A question naturally arises that 
whether or not in a typical limit cycle in dynamical sys- 
tems a potential can be constructed. We demonstrate in 
this section that the answer is a straightforward yes. 

It has been suggested that a typical and simple limit 
cycle in two dimensions would take following dynamical 
equation in a polar coordinate representation 12 : 

q = R(q) (15) 
9 = $(q) (16) 

Here the smooth functions R, $ have properties R(q = 
1) = is a fixed point in the radial coordinate and Q(q — 
1) = constant. It is mathematically possible that any 
limit cycle in two dimension can be deformed into a cycle, 



and, at least near this limit cycle, the dynamical equation 
can be mapped into above form by a nonlinear coordinate 
transformation. 

The comparison between Eqs. (11,12) and Eqs.(15,16) 
immediately suggests what considered in section II is just 
such a typical limit cycle. Hence, we can conclude that 
the potential and limit cycle coexist for such cases. 

Nevertheless, we should point out an interesting para- 
doxical feature. On one side it is known from the theory 
of dynamical systems that a limit cycle is robust^. Any 
small parameter change in the equation would not lead 
to its disappearing. On other side, from the demonstra- 
tion in section II which is based on the understanding 
from physical sciences, the existence of the limit cycle is 
a result of a very delicate balance between all dynamical 
elements: The friction matrix, the gradient of potential 
function, and the antisymmetric matrix are all zero at 
the limit cycle. How this feature would play a role in our 
better understanding limit cycle and its control will be 
an interesting problem for further exploration. 

IV. GENERAL CONSTRUCTION OF 
EVOLUTION POTENTIAL 

A particular challenging and careful reader would ob- 
serve that we have not demonstrated the potential for a 
general limit cycle in arbitrary dimensions. Hence there 
might exist a type of limit cycle, which will not be ones 
such as discussed above, such that a potential might not 
exist. We have been unable to give an explicit demon- 
stration for the existence of potential for a most generic 
limit cycle (periodic attractors). However, we point out 
that such a discussion has been done for a generic fixed 
point (point attractors)^. Furthermore, we do have a 
generic construction of potential for a general situation. 
This construction suggests it is possible to do so gener- 
ally for arbitrary limit cycles. The general method has 
been presented elsewhere^. Here we outline its key ideas 
to make the present demonstration complete. 

We restore the stochastic force back into the general 
equation in dynamical systems and consider an arbitrary 
dimension n instead merely two dimensions: 

q = f(q,t)+C(q,*)- (17) 

Here f (q, t) is the deterministic nonlinear drive of the 
system and the stochastic drive is £(q, t), which differs 
from that in Eq.(l) but comes from the same dynamical 
source. For simplicity we will assume that f is a smooth 
function whenever needed. To be consistent with Eq.(l) 
and (2), the stochastic drive in Eq.(17) is also assumed 
to be Gaussian and white with the variance, 

(C(q, t)C(q, t')) = 2U(q, t) e 5(t - t'), (18) 

and zero mean, (C(q, t)) = 0. The matrix D is the diffu- 
sion matrix. 

Assuming that both Eq.(l) and (17) describe the same 
dynamics. It is rather easy to derive Eq.(17) from Eq.(l). 
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The difficult part is to derive Eq.(l) from Eq.(17). Using 
Eq.(17) to eliminate q in Eq.(l), and noticing that the 
dynamics of noise and the state variable behave indepen- 
dently, we have, the deterministic part, 

[S(q, t) + T(q, i)]f (q, t) = -V^(q, t) , (19) 

and the stochastic part, 

[5(q,t)+T(q,t)]C(q,t)=€(q,t) . (20) 

Those two equations suggest a rotation in state space. 

Multiplying Eq.(20) by its own transpose of each side 
and carrying out the average over stochastic drive, we 
have 

[S(q, t) + T(q, t)]D(q, t) [5(q, t) - T(q, t)] = S(q, t) . 

(21) 

In obtaining Eq.(21) we have also used Eq.(2) and (18). 
Eq.(21) gives n(n+l)/2 conditions because it is symmet- 
ric under the transpose operation. 

Using the property of the potential ip: V x V^> = 
[(V x Vi/))ij = (ViVj - ViVj)^ ], Eq.(19) leads to 

Vx[[%f)+T(q,f(q)]=0, (22) 

which gives n(n — l)/2 conditions because the antisym- 
metric condition implied. 

Combining both Eq.(21) and (22), we have total n 2 
conditions, which is exactly the number to determine the 
nxn matrix [5(q, f)+T(q, t)], when supplemented by ap- 
propriate boundary condition needed by the partial dif- 
ferential equations of Eq.(22). This additional boundary 
condition should be the delicate balance condition dis- 
cussed in section II and III: When approaching the limit 
cycle, the friction matrix must approach to zero faster 
than the potential gradient as well as the antisymmetric 
matrix. Once [S'+T] is known, it is straightforward to ob- 
tain the potential according to Eq.(19), hence construct 
Eq.(l) and (2) from Eq.(17) and (18). 

The general existence of the potential implies that in- 
deed the energy landscape concept in physical sciences 
should be one of the most important concepts in dynam- 
ics systems, too. Thus, not only the potential exist in pe- 
riodic attractors, may also in the strange attractors. This 
would have implications in other fields where dynamical 
behaviors are the primary concerns. For example, we 
have shown elsewhere^ that the mathematical structure 
of population genetics can be formulated in such a way 
to incorporate the important concept of potential. 

V. DISCUSSIONS 

There are two mathematical subtleties. First, it is 
known that even with a limit cycle the dynamics is dis- 
sipative, reflecting by the fact that in general V • f ^ 0, 
where / is defined by Eq.(17). This is also expressed by 
the fact that the so-called diffusion matrix, D defined in 



Eq.(18), is finite even at the limit cycle. Because it is 
dissipative, it would be difficult to conceive a constant 
potential (or a Lyapunov function) along the limit cycle 
on which the dynamics repeats itself indefinitely. The 
delicate point is that, as shown in our above demonstra- 
tion, that the friction matrix S is zero along the limit 
cycle does not implies the diffusion matrix D is zero. In 
fact, it is finite according to Eq.(21): 

D = ^[(S + T)- 1 + (S -T)- 1 } . (23) 

An interesting and direct implication is that the state- 
ment that one cannot construct Hopfield potential (or 
Lyapunov function) in limit cycle in computing by at- 
tractors in the neural networks* is not true. 

We come to the second point. For deterministic dy- 
namics, if one finds one Lyaponov function, one finds 
many. This is illustrated by the present construction that 
additional information from the noise is needed: different 
diffusion matrix would lead to different potential func- 
tion. Hence, this may provide a method to select best 
suitable Lyapunov function or potential function to ones 
own problem by choosing appropriate form the diffusion 
matrix. 

It is perhaps worthwhile to point out that the typi- 
cal gradient systems in dynamical systems theory cor- 
responds to the zero transverse matrix, T = 0, in the 
present construction. No limit cycle is possible in this 
case. In dynamics described by gradient systems the 
trajectory could follow the most rapid descendant path 
along the landscape defined by the potential. In this case 
it is easy to identify the potential as the landscape func- 
tion. For a general dynamics where the transverse ma- 
trix is not zero, the trajectory would not follow the most 
rapid descendant route along the potential, as expressed 
by Eq.(l). Nevertheless, the meaning of the potential re- 
mains the same as that in gradient systems: determining 
the final distribution. 



VI. CONCLUSIONS 

Based on the demonstrations in section II-IV, we con- 
clude that a potential can coexists with limit cycle. Such 
a potential determines the final distribution according to 
a Boltzmann-Gibbs distribution. This may provide an al- 
ternative perspective to study the metastability of limit 
cycle from Kramers potential landscape point of view. In 
regarding to computing by attractors in neural networks, 
the present article shows that the Hopfield potential ex- 
ists for periodic attractors. 
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